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TECHNICAL FIELD 



This invention relates to network systems, and particularly public network 
systems, such as the Memet More particularly, this invention relates to methods 
which improve distribution of streaming continuous data (e.g., audio and video 
data) from a content provider over a network to a subscriber's computer or other 
content rendering unit. 

BACKGROTJND OF THE INVENTION 

Public networks, and most notably the Intemet, are emerging as a primary 
conduit for communications, entertainment, and business services. The Memet is 
a network formed by the cooperative interconnection of computing networks, 
including local and wide area networks. It interconnects computers from around 
the world with existiQg and even incompatible technologies by employing common 
protocols that smoothly integrate tiie individual and diverse components. 

The Intemet has recently been popularized by the overwhehning and rapid 
success of the World Wide Web (WWW or Web). The Web is a graphical user 
interface to the Intemet that facilitates interaction between users and the Intemet. 
The Web links together various topics in a complex, non-sequential web of 
associations which permit a user to browse from one topic to another, regardless of 
the presented order of topics. A "Web browsei^ is an application which executes 
on the user's computer to navigate the Web. The Web browser allows a user to 
retrieve and render hypermedia content from the WWW, including text, sound, 
images, video, and otiter data. 

One problem facing the continued growth and acceptance of the Intemet 
concerns dissemination of streaming continuous data, such as video and audio 
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content. Data is delivered and rendered to users in essentially two formats. The 
first format, referred to as "block data," entails downloading the entire data set to 
local storage and then rendering die data firom the locally stored copy. A second 
dehvery format, known as "streaming data," entails sending bits of data 
continuously over the network for just-in-time rendering. 

Computer network users have been conditioned through their experiences 
wifli television and CD-ROM multimedia applications to expect instantaneous 
streaming data on demand. For technical reasons, however, the Internet is often 
unable to deliver streammg data. This mability is most pronounced for video data. 
In the Internet context, there is often long delays between the time video content is 
requested and the time when the video content actually begms playing. It is not 
uncommon to wait several minutes for a video file to begitt playing. In essence, 
for factors discussed below, video data is traditionally delivered as "block data" 
over the Internet and thus requires that the entire file be downloaded prior to 
rendering. 

The inability to provide streaming data is a result of too litfle bandwidth in 
the distribution network. "Bandwidth" is the amount of data that can be moved 
through a particular network segment at any one time. The Internet is a 
conglomerate of different technologies with different associated bandwidlhs. 
Distribution over the Internet is usually constrained by the segment with the lowest 
available bandwidth. 

Fig. 1 shows a model of a public networic system 20, such as die Internet 
The network system 20 includes a content server 22 (e.g., a Web server) which 
stores and serves multimedia data over a distribution network 24. The network 
system 20 also has regional independent service providers (ISPs) or point of 
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presence (POP) operators, as represented by ISP 26, which provide the 
connectivity to the primaiy distribution network 24. Many users, as represented 
by subscriber computers 28, 30, and 32, are connected to the ISP 26 to gain access 
to the Intemet 

The ISP 26 is connected to the distribution network 24 with a network 
connection 34. In this example illustration, the network connection 34 is a "Tl" 
connection, "Tl" is a imit of bandwidth having a base throughput speed of 
approximately 1.5 Mbps (Megabits per second). Another common high bandwidth 
connection is a T3 connection, which has a base throughput speed of 
approximately 44.7 Mbps. For purposes of explaining the state of the technology 
and the practical problems with providing real-time streaming data over the 
Intemet, it is suflEicient to understand that there is also a limited bandwidth 
connection between the content server 22 and the distribution network 24. 

The subscriber computers 28, 30, and 32 are connected to flieir host ISP 26 
via home entry lines, such as telephone or cable lines, and compatible modems. 
As examples of commercially available technology, subscriber computer 28 is 
connected to ISP 26 over a 14.4K connection 36 which consists of a standard 
telephone line and a V.32bis modem to enable a maximum data rate of 14.4 Kbps 
(Kilobits per second). Subscriber computer 30 is connected to the ISP 26 with a 
28.8K connection 38 (telephone line and V.34 modem) which supports a data rate 
of 28.8 Kbps. Subscriber computer 32 is connected to the ISP 26 with an ISDN 
connection 40 which is a special type of telephone line that facilitates data flow in 
the range of 128-132 Kbps. Table 1 summarizes connection technologies that are 
available today. 
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Table 1: Connection Technologies and Throughput 
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With a Tl connection to the primaiy distribution network 24, the ISP 26 
can fecilitate a maximum data flow of approximately 1.5 Mbps. This bandwidth is 
available to serve all of the subscribers of the ISP. When subscriber computer 28 
is connected and downloading data files, it requires a 14.4 Kbps sHce of the 1.5 
Mbps bandwidth. Subscriber computers 30 and 32 consume 28.8 Kbps and 128 
Kbps slices, respectively, of the available bandwidth. 

The ISP can accommodate simultaneous requests fi:om a number of 
subscribers. As more subscribers utilize the ISP services, however, there is less 
avaflable bandwidth to satisfy the subscribers requests. If too many requests are 
received, the ISP becomes overburdened and may not be able to adequately service 



4 hm 70632 m9960856C:\m2^DOWS\rEMPWSl-095VS.pat.i^.doe 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 

a 

12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



{ c 

the requests in a timely maimer, causing firustration to the subscribers. If latency 
problems persist, the ISP can purchase more bandwidth by adding additional 
capacity (e.g., upgrading to a T3 connection or adding more Tl connections). 
Unfortunately, adding more bandwidth may not be economically wise for the ISP. 
The load placed on the ISP typically fluctuates throughout different times of the 
day. Adding expensive bandwidth to more readily service short duration high- 
demand times may not be profitable if the present capacity adequately services the 
subscriber traffic during most of the day. 

The latency problems are perhaps the most pronounced when working with 
video. There are few things more finstrating to a user than trying to download 
video over the Mtemet. The problem is that video requires large bandwidth in 
comparison to text files, graphics, and pictures. Additionally, unlike still images 
or text files, video is presented as moving images which are played continuously 
without interruption, Weo typically requires a 1.2 Mbps for real-time streaming 
data. This 1.2 Mbps throughput requirement consumes nearly all of a Tl 
bandwidth (1.5 Mbps). Accordingly, when multiple subscribers are coupled to the 
ISP and one subscriber requests a video file, there is generally not enough capacity 
to stream the video in real-time firom the content server 22 over the Intemet to the 
requesting subscriber, instead, the video file is typically delivered in its entirety 
and only then played on the subscriber computer. Unfortunately, even 
downloadiug video files in the block data format is often inconvenient and usually 
requires an excessive amount of time. 

Consider the following example. Suppose a subscriber wishes to access the 
CNN Web site on the Intemet for an account of recent news. As part of the news 
materials, CNN provides a twenty second video clip of an airplane hijacking 
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incident At 1.2 Mbps, the 20 second video clip involves downloading a 24 Mbyte 
file over the Ihtemet If the user has a modest 14.4 Kbps connection, it would take 
approximately 28 minutes to download the entire file. 

Now, assume that the subsciiber/ISP connection is sufficiently large to 
handle real-time video streaming of the video file, meaning that the subscriber 
computer can render the video data as it is received fi-om the ISP. Despite flie 
bandwidth of the subscriber/ISP connection, real-time video streaming may still be 
unachievable if the Tl connection 34 between the ISP 26 and the distribution 
network 24 is unable, or unwilling due to policy reasons, to dedicate 1.2 Mbps of 
its bandwidth to the video file. Requests for the CNN video clip made during peak 
traffic times at the ISP most certainly could not be accommodated by the 
ISP/network connection. Since adding more bandwidth may be a poor iavestment 
for the ISP, the ISP may have no economic incentive to remedy the latency 
problem. The result is that some users might be iaconvenienced by the lack of 
ability to receive streaming video despite their own connection to the ISP being 
capable of accommodating streaming video. 

The latency problem is fiirther aggravated if the connection between the 
content server 22 and the distribution network 24 is equally taxed. The lack of 
sufficient bandwidth at the content server/network link could also prevent real- 
time video streaming over the Internet, regardless of the bandwidths of the 
network/ISP link or the ISP/subscriber link. If all links lack sufficient bandwidth, 
the latency problem can be compounded. 

One solution to this problem is to provide local cache storage at tiie ISP. As 
subscribers request files from the Intemet, the ISP caches the files locally so that 
subsequent requests are handled in a more expeditious manner. This process is 
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known as "on-demand caching/' Local on-demand caching methods improve the 
ability to deliver video content over the Intemet When the first subscriber 
requests the CNN video cUp of die airplane hijacking incident, the ISP requests the 
video clip from the CNN server, and facilitates delivery of the video clip to the 
requesting subscriber. The ISP also caches the video clip in its own memory. 
When any subsequent subscriber requests the same CNN video clip, the ISP serves 
the local version of the video clip from its own cache, rather than requesting the 
clip from the CNN server. If the subscriber computer has a high bandwidth 
connection with die ISP, the locally stored video clip can be served as continuous 
streaming video data for instantaneous rendering on the subscriber computer, 

A drawback of the on-demand caching method is tiiat the first requesting 
subscriber is faced with the same latency problems described above. All 
subsequent subscribers have the benefit of the cached version. However, if the 
initial delay is too long, there may not be any subscriber who is willing to assume 
the responsibility of ordering the video file and then waiting for it to doAvnload. 

Accordingly, there remains a need to develop improved techniques for 
facilitating distribution of streaming video over public networks, such as the 
Intemet 

SUMMARY OF THE INVENTION 

This invention provides improved methods for delivering large amounts of 
data, such as streaming audio and video data, over a network, such as the Intemet. 
According to one aspect, the method involves an intelligent, pre-caching and pre- 
loading of frequently requested content to the local service provider (e.g., ISP or 
LAN network server) prior to peak demand times when the content is likely to be 
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requested by the subscribers. lu this manner, the frequently requested content is 
akeady downloaded and ready to be served to the subscribers before they actually 
request it When the content is finally requested, the data is streamed continuously 
in real-time for just-in-time rendering at the subscriber. This eliminates the 
latency problems of prior art systems because die subscribers do not have to wait 
for the downloadittg of video and audio files over the Intemet. Moreover, 
intelligently pre-caching content before peak demand times is more effective than 
traditional on-demand caching because the content is available to the first 
subscriber who requests it. 

la one implementation, the network system includes a content provider 
connected to local service providers via a distribution network. The local service 
providers facilitate delivery of the content from the content provider to multiple 
subscribers. The local service providers are configured to request certain content 
from the content provider prior to a peak time when the subscribers are likely to 
request the content. The content is downloaded from the content provider during 
non-peak hours and cached at the local service providers for serving to the 
subscribers during the ensuing peak time. 

The local service provider includes a processing control unit, a cache 
memory, and a continuous media server. A hit recording module executes on the 
processing control unit to record requests for particular content from the 
subscribers. In the Intemet context, these requests are submitted in the form of 
URLs (universal resource locators) for target resources located on the Web. A 
pattem recognizer detects behavior patterns based on subscriber requests to 
determine which content the subscribers are most likely to request and when. A 
scheduler then schedules requests for the frequenfly requested content from the 
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content provider at a selected time prior to the peak demand time for that content. 
These requests are posted to the content provider at their scheduled times, and the 
content provider downloads the content during the off-hours prior to the peak time. 

When the content is received from the content provider, the local service 
provider stores the content in the cache memory. For instance, the content might 
be a Web page from a frequently visited Web site. Web pages are typically 
designed as hypermedia documents to provide rich multimedia presentations which 
blend text, images, sound, and video. If the Web page references or includes 
continuous data files, such as audio or video files, these files are stored in a 
continuous media server. The target specifications embedded in the Web page to 
reference tiie continuous data files are modified to reference the local copy of the 
continuous data files, as opposed to the original location of tiie files at the Web 
site. 

During the ensumg peak time, the processing control unit serves the target 
resources maintained in the cache memory to the subscribers. If any subscriber 
clicks on or otherwise activates a link to an audio or video file, the requested file is 
served as a continuous stream of data from the continuous media server at the ISP. 
In this manner, tiie continuous video or audio data stream can be rendered just-in- 
time by the subscriber. 

Another aspect of this invention involves supplementing the primary 
Intemet cormection owned by the ISP with a delivery of content over a secondary 
network. This supplemental delivery effectively increases bandwidth between the 
content provider and the local service provider. In the described implementation, 
the content provider broadcasts additional content over a broadcast satellite 
network to the local service provider. The broadcast communication link offers 
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additional bandwidth at a fraction of the cost tiiat would be incurred if the local 
service provider installed additional Internet connections, such as Tl or T3 
connections. The broadcasted content is stored at the local service provider and 
served during peak times to afford continuous audio streaming to the subscribers. 

BRIEF PESCRIPTTON OF THE DRAWINGS 

Fig. 1 is a diagrammatic illustration of a network system which is used to 
e^i^lain the present state of Intemet technology. 

Fig. 2 is a diagrammatic illustration of a network system constructed 
according to one implementation of this invention. 

Fig. 3 is a diagrammatic illustration of a network system constructed 
according to another nnplementation of this invention. 

Fig. 4 is a block diagram of the functional components in a local service 
provider in the network system. 

Fig. 5 is a flow diagram of a method for operating the local service 
provider. 

Fig, 6 is a diagrammatic illustration of a network system according to still 
another implementation of this invention. 

The same reference numbers are used throughout the figures to reference 
like components and features. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Fig. 2 shows a pubUc network system 50. It includes multiple content 
servers, as represented by content server 52, which store and serve content over a 
network 54. The content server 52 serves content in flie form of text, audio, video, 
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graphic images, and other raultimedia data. Jn the Memet context, the content 
servers might represent Web sites which serve or multicast content in the form of 
hypermedia docmnents (e.g., Web page) which link text, images, somids, and 
actions in a web of associations that permit a user to browse through related 
topics, regardless of tiie presented order of the topics. The content server 52 might 
altematively represent headend servers for a cable company which transmit video 
content over a cable network, or an audio server for a radio station that sends 
audio data over the network. The content server 52 might further represent servers 
for educational institutions, public agencies, libraries, merchants, or any other 
public or private organizations which serve or multicast information over the 
network. 

The network 54 is a high-speed, high-bandwidth interactive distribution 
network, and can be representative of the Internet. Traffic over the network 54 is 
organized according to protocols which define how and when data is moved. One 
example protocol is the transmission control protocol/Intemet protocol (TCP/IP) 
which forms the backbone of the Intemet. The network 54 might be implemented 
using various physical mediums, including wirebased technologies (e.g., cable, 
telephone lines, etc.) and wireless technologies (e.g., satellite, cellular, infrared, 
etc.). The network is operated according to high-speed switching services, 
including connection-oriented network services (e.g., frame relay, asynchronous 
transfer mode (ATM), etc.) and coimectionless services (e.g., switched 
multimegabit data service, etc.). These switching services support connection 
speeds of several Megabits per second (Mbps), up to Gigabits per second (Gbps). 
At these speeds, the network 54 is capable of supporting streaming video data 
which requires 1.2 Mbps. 
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Many independent service providers (ISPs), as represented by ISP 56, 
function as terminal connections or "on-ramps" to the high-speed network 54, The 
ISP 56 acts as an intermediary between tiie subscribers 58 and 60 and the network 
54, The ISP 56 has a network port 62 which provides a high-speed, high- 
bandwidth connection 64 to the network 54. The ISPs segment and rent portions 
of the bandwidth to the multiple subscribers 58 and 60 so that the subscribers do 
not individually need to purchase and maintain their own network connections. 
The ISPs 56 may also be referred to as point of presence (POP) servers, and the 
names 'TSF' and 'TOP" are used interchangeably in this disclosure. 

The subscriber personal computers (PCs) 58 and 60 are individually 
connected to the ISP 56 by permanent or sessional dial-up connections. 
Conventional telephone or cable lines and compatible modems are used to form 
the connections 66, 68. Examples of suitable technologies include HFC, ISDN, 
POTS, and ADSL. The ISP 56 has network terminal switching equipment 70 to 
accommodate the connections to tiie subscriber PCs 58, 60. 

The ISP 56 also has a cache server 72 and a continuous media server 
(CMS) 74. The cache server 72 is configured as a conventional database server 
having processing capabilities, including a CPU (not shown), and storage 78. As 
one example, the cache server 72 is implemented as a SQL (Structure Query 
Language) database. The cache server 72 caches Internet resources, such as those 
requested by subscriber computers 58, 60, that have been downloaded from the 
content provider 52 to allow localized serving of those resources. 

The CMS 74 is a server designed particularly for serving continuous data 
streams, such as video data and audio data, in an ordered and uninterrupted 
manner. As one example implementation, the continuous media server is 
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configured as a disk array data storage system consisting of many large capacity 
storage disks with video and audio data streams stored digitally thereon. The 
locations of the video and audio data streams are kept in a memory map and each 
video and audio data stream is accessed through pointers to the particular memory 
location. To serve the audio or video data, the processor 80 grabs the pointer to 
the video stream and begms retrieving the video firom the storage disk 82 and 
streaming it over the communication line 66, 68 to the requesting subscriber 
computing unit. 

Fig. 3 shows a network system 90 which is implemented in a local area 
network (LAN) configuration. This implementation is exemplary of how a 
company or multi-user organization might be connected to the Intemet. The 
network system 90 differs from the system of Fig. 2 in that the local service 
provider which facilitates the on-ramp connection to the high-speed, high- 
bandwidth network 54 is itself a local server 92 on a LAN 94. The LAN 94 can be 
constructed using conventional network topologies, such as Ethemet. The LAN 
network server 92 has a network port 96 which enables a high-speed, high- 
bandwidth connection 98 to the network 54. The cache server 72 and CMS 74 are 
connected to the LAN 94. Workstations or other computing units 100, 102 are 
connected to the LAN 94 and are served by tiie LAN network server 92 in regards 
to Ihtemet access. In this configuration, the LAN users of workstations 100, 102 
have access to the Ihtemet through their enterprise LAN 94 and the LAN network 
server 92. 

It is noted that both implementations of Figs. 2 and 3 are shown and 
described as suitable examples for implementing various aspects of the invention. 
However, the network system might be implemented in a variety of arrangements. 
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M addition, the illustrations show tiie subscriber units as being personal computers 
or work stations. However, the subscriber units can be implemented in other 
forms which are capable of rendering content received over the network. As 
examples, the subscriber computing units might include televisions, computers, 
game devices, handheld devices, and the like. 

As explained in the Background section, conventional techniques for 
delivering video and audio content over the Intemet is plagued with latency 
problems. An aspect of this invention is to provide an improved method for 
delivering streaming audio and video content over a network system. The 
technique involves an intelligent, pre-caching and pre-loading of certain content at 
the local service provider (e.g., ISP, POP, LAN network server) prior to optimal or 
peak demand tunes when the content is likely to be requested by the subscribers. 
In this manner, the frequently requested content is akeady downloaded and ready 
for access from the subscribers before they actually request it. When it is finally 
requested, the data can be streamed continuously in real-time for just-in-time 
rendering from the local service provider to the subscriber. This eliminates the 
latency problems of prior art systems. Moreover, intelligently pre-caching content 
before peak demand times is more effective than traditional on-demand caching 
because the content is available to the first subscriber who requests it. 

Fig. 4 shows a fimctional block diagram of a local service provider 110 
according to one implementation which enables intelligent pre-caching and pre- 
loading. At its most fimdamental level, the local service provider 110 provides an 
on-ramp connection to the Intemet for its subscribers. The subscribers send 
requests to the local service provider 110 for content available on the Mtemet The 
local service provider acts as an iatermediary facihtator which communicates the 
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requests to the appropriate content server and then returns the requested content to 
the appropriate subscribers. 

The local service provider 110 has a request handler 111 which manages 
requeste received from the subscribers, fii the Web context, the subscriber 
computers run Web browser applications which generate requests in the form of 
universal resource locators (URLs). A URL describes everything about a 
particular resource that a Web browser needs to know to request and render it. 
The URL describes the protocol a browser should use to retrieve the resource, the 
name of the computer it is on, and the path and file name of the resource. The 
following is an example of a URL: 

http: / /www.microsoft. com/upgrades 

The "http://"' portion of the URL describes the protocol. The letters "http" 
stand for HyperText Transfer Protocol, the set of rules that a browser will follow 
to request a document and the remote server wiU follow to supply the document. 
The "vsrww.microsoft.com" portion of the URL is the name of the remote host 
computer which maintains the document. The last portion "/upgrades" is the path 
and file name of the document on the remote host computer. 

When the request handler 111 receives a request, &e local service provider 
110 first looks to its own cache memory 124 to determine if a proxy copy of the 
target resource referenced by the URL is stored locally. The cache memory 124 
serves as a quasi-temporary local storage for holding proxy copies of often used 
and requested target resources. The cache memory 124 can be implemented using 
different types of memory, includiag RAM, storage disks (optical, magnetic, etc.), 
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